Exploring Bimanual Haptic Feedback for Spatial Search in Virtual Reality.

Spatial search tasks are common and crucial in many Virtual Reality (VR) applications. Traditional methods to enhance the performance of spatial search often employ sensory cues such as visual, auditory, or haptic feedback. However, the design and use of bimanual haptic feedback with two VR controllers for spatial search in VR remains largely unexplored. In this work, we explored bimanual haptic feedback with various combinations of haptic properties, where four types of bimanual haptic feedback were designed, for spatial search tasks in VR. Two experiments were designed to evaluate the effectiveness of bimanual haptic feedback on spatial direction guidance and search in VR. The results from the first experiment reveal that our proposed bimanual haptic schemes significantly enhanced the recognition of spatial directions in terms of accuracy and speed compared to spatial audio feedback. The second experiment's findings suggest that the performance of bimanual haptic feedback was comparable to or even better than the visual arrow, especially in reducing the angle of head movement and enhancing searching targets behind the participants, which was supported by subjective feedback as well. Based on these findings, we have derived a set of design recommendations for spatial search using bimanual haptic feedback in VR.

ClockRay: A Wrist-Rotation based Technique for Occluded-Target Selection in Virtual Reality.

Target selection is one of essential operation made available by interaction techniques in virtual reality (VR) environments. However, effectively positioning or selecting occluded objects is under-investigated in VR, especially in the context of high-density or a high-dimensional data visualization with VR. In this paper, we propose ClockRay, an occluded-object selection technique that can maximize the intrinsic human wrist rotation skills through the integration of emerging ray selection techniques in VR environments. We describe the design space of the ClockRay technique and then evaluate its performance in a series of user studies. Drawing on the experimental results, we discuss the benefits of ClockRay compared to two popular ray selection techniques - RayCursor and RayCasting. Our findings can inform the design of VR-based interactive visualization systems for high-density data.

Effects of Transfer Functions and Body Parts on Body-Centric Locomotion in Virtual Reality.

Body-centric locomotion allows users to control both movement speed and direction with body parts (e.g., head tilt, arm swing or torso lean) to navigate in virtual reality (VR). However, there is little research to systematically investigate the effects of body parts for speed and direction control on virtual locomotion by taking in account different transfer functions(L: linear function, P: power function, and CL: piecewise function with constant and linear function). Therefore, we conducted an experiment to evaluate the combinational effects of the three factors (body parts for direction control, body parts for speed control, and transfer functions) on virtual locomotion. Results showed that (1) the head outperformed the torso for movement direction control in task completion time and environmental collisions; (2) Arm-based speed control led to shorter traveled distances than both head and knee. Head-based speed control had fewer environmental collisions than knee; (3) Body-centric locomotion with CL function was faster but less accurate than both L and P functions. Task time significantly decreased from P, L to CL functions, while traveled distance and overshoot significantly increased from P, L to CL functions. L function was rated with the highest score of USE-S, -pragmatic and -hedonic; (4) Transfer function had a significant main effect on motion sickness: the participants felt more headache and nausea when performing locomotion with CL function. Our results provide implications for body-centric locomotion design in VR applications.

Understanding the Effects of Tactile Grating Patterns on Perceived Roughness Over Ultrasonic Friction Modulation Surfaces.

OBJECTIVE: Our study aims to investigate the effects of grating patterns of perceived roughness on surfaces with ultrasonic friction modulation, and also to examine user performance of identifying different numbers of grating patterns. BACKGROUND: In designing grating-based tactile textures, the widths of low- and high-friction zones are a crucial factor for generating grating patterns that convey roughness sensation. However, few studies have explored the design space of efficient grating patterns that users can easily distinguish and identify via roughness perception. METHOD: Two experiments were carried out. In the first experiment, we conducted a magnitude estimation of perceived roughness for both low- and high-friction zones, each with widths of 0.13, 0.25, 0.38, 0.5, 1.0, 1.5, 2.0, 3.5, and 5.5 mm. In the second experiment, we required participants to identify 5 pattern groups with 2-6 patterns respectively. RESULTS: Perceived roughness fitted a linear trend for low- or high-friction zones with widths of 0.38 mm or lower. Perceived roughness followed an inverted U-shaped curve for low- or high-friction zones with widths greater than 0.5 mm but less than 2.0 mm. The peak points occurred at the widths of 0.38 mm for both low- and high-friction zones. The statistical analysis indicates that both low- and high-friction zones had similar effects on human perception of surface roughness. In addition, participants could memorize and identify up to four tactile patterns with identification accuracy rates higher than 90% and average reaction time less than 2.2 s. CONCLUSIONS: The relation between perceived roughness and varying widths of grating patterns follows linear or inverted U-shape trends. Participants could efficiently identify 4 or fewer patterns with high accuracy (>90%) and short reaction time (<2.2 s). APPLICATION: Our findings can contribute to tactile interface design such as tactile alphabets and target-approaching indicators.

Graph based multi-scale neighboring topology deep learning for kidney and tumor segmentation.

Objective.Effective learning and modelling of spatial and semantic relations between image regions in various ranges are critical yet challenging in image segmentation tasks.Approach.We propose a novel deep graph reasoning model to learn from multi-order neighborhood topologies for volumetric image segmentation. A graph is first constructed with nodes representing image regions and graph topology to derive spatial dependencies and semantic connections across image regions. We propose a new node attribute embedding mechanism to formulate topological attributes for each image region node by performing multi-order random walks (RW) on the graph and updating neighboring topologies at different neighborhood ranges. Afterwards, multi-scale graph convolutional autoencoders are developed to extract deep multi-scale topological representations of nodes and propagate learnt knowledge along graph edges during the convolutional and optimization process. We also propose a scale-level attention module to learn the adaptive weights of topological representations at multiple scales for enhanced fusion. Finally, the enhanced topological representation and knowledge from graph reasoning are integrated with content features before feeding into the segmentation decoder.Main results.The evaluation results over public kidney and tumor CT segmentation dataset show that our model outperforms other state-of-the-art segmentation methods. Ablation studies and experiments using different convolutional neural networks backbones show the contributions of major technical innovations and generalization ability.Significance.We propose for the first time an RW-driven MCG with scale-level attention to extract semantic connections and spatial dependencies between a diverse range of regions for accurate kidney and tumor segmentation in CT volumes.

Global-Local Multiple Granularity Learning for Cross-Modality Visible-Infrared Person Reidentification.

Cross-modality visible-infrared person reidentification (VI-ReID), which aims to retrieve pedestrian images captured by both visible and infrared cameras, is a challenging but essential task for smart surveillance systems. The huge barrier between visible and infrared images has led to the large cross-modality discrepancy and intraclass variations. Most existing VI-ReID methods tend to learn discriminative modality-sharable features based on either global or part-based representations, lacking effective optimization objectives. In this article, we propose a novel global-local multichannel (GLMC) network for VI-ReID, which can learn multigranularity representations based on both global and local features. The coarse- and fine-grained information can complement each other to form a more discriminative feature descriptor. Besides, we also propose a novel center loss function that aims to simultaneously improve the intraclass cross-modality similarity and enlarge the interclass discrepancy to explicitly handle the cross-modality discrepancy issue and avoid the model fluctuating problem. Experimental results on two public datasets have demonstrated the superiority of the proposed method compared with state-of-the-art approaches in terms of effectiveness.

Tri-mean-based statistical differential gene expression detection.

Based on the assumption that only a subset of disease group has differential gene expression, traditional detection of differentially expressed genes is under the constraint that cancer genes are up- or down-regulated in all disease samples compared with normal samples. However, in 2005, Tomlins assumed and discussed the situation that only a subset of disease samples would be activated, which are often referred to as outliers.